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(57) The present invention makes it possible for a 
user to share a virtual three dimensional space consist- 
ing of a plurality of media in a large wide-area network 
which includes a wide-band/ high-speed network (101) 
and narrow-band/ low-speed network (103). without 
causing congestion in the network. The present inven- 
tion Include a multicast message transmitting unit (111) 
and multicast message receiving unit (108) for perform- 
ing multicast communication in the wide-band/ high- 
speed network (101), a unicast message transmitting 
unit (1 12) and unicast message receiving unit (106) for 
performing unicast communication in the narrow- 
banoViow-speed network (103). A multicast group man- 
aging unit (107), multicast message generating unit 
(110) and unicast message generating unit (109) coor- 
dinate the unica6t communication and the multicast 
communication. A message thinning/ re-assembling 
unit (113) reduces the communication traffic in the nar- 
row-band/low-speed network (103). and the wide-band, 
high-speed network (101) and the low-band/low-speed 
network (102) are provided with respective terminals 
(102. 104) far sharing three dimensional virtual environ- 
ment. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 1 The present invention relates to a virtual three 
dimensional space sharing system in which a plurality of 
users geographically separated can communicate with 
each other, in a virtual three dimensional space created 
on a computer network, using a plurality of Information 
media such as three dimensional or two dimensional 
computer graphics, real-time video, live sound, voice 
and pre-recorded 6ound. in a large wide-area network 
that co-axists with the wide-band/ high-speed networks 
and narrow-band/ low-speed networks. 

Description of the Prior Art 

[0002] FIG. 19 illustrates an example of a convex 
tional virtual three dimensional space sharing device 
which is disclosed for example, in the Japanese laid- 
open publication 7-288791. For the sake of simplicity, 
FIG. 19 illustrates a case where one virtual space shar- 
ing device accommodates three terminals. 
[0003] FIG. 19 illustrates a virtual space sharing 
device 2010, The virtual space sharing device 2010 
includes line interface units 2011. 2012 and 2013. a 
position information distributing unit 2014. a distance 
calculating unit 2015. a visual axis matching calculating 
unit 2016. and a video thinning rate determining unit 
20 1 7. and an inter-video rhinning/ distributing unit 201 8 
[0004] The virtual space sharing device 201 0 further 
includes video receiving internal Duses 2019. 2023 and 

2027. video transmitting internal buses 2020. 2024 and 

2028. position information transmitting internal buses 
2022, 2026 and 2030. a distance calculation result 
transferring internal bus 2031 , a video thinning rate noti- 
fying internal bus 2033 and communication iines 2034, 
2035 and 2036 (INS64). 

[0005] The operation of this device is explained below. 
The virtual space sharing device 2010 transmits / 
receives the video and position information via INS64 
lines 2034, 203S and 2036 to / from the terminals. First 
of all, the data from the lines 2034, 2035 and 2036 are 
received In The line interface units 201 1 . 2012 and 2013. 
[0006] The line interface units 201 1 , 2012 and 2013 
analyze the received data, if the data are video, the 
video is transferred to The inter-video thinning/ distribut- 
ing unit 2018 via internal buses 2019, 2023 and 2027, 
and also to the distance calculating unit 2015 and the 
visual axis matching calculating unit 2016 via internal 
buses 2021. 2025 and 2029. 

[0007] The position information distributing unit 201 4 
copies the position information which is received from 
the internal bus 2021 . and transfers the copy to the line 
interface units 2012 and 2013 via the internal buses 
2026 ?nd 2030. The position information distributing 
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unit 2014 also copies the position information which is 
received from the internal bus 2025, and transfers the 
copy to the line interface units 201 1 and 2013 via inter- 
nal buses 2022 and 2030. 

5 [0008] Furthermore, the position information distribut- 
ing unit 2014 copies the position information wh<ch is 
received from the internal bus 2029, and transferrers 
the copy to the line interface units 201 1 and 2012 via the 
internal buses 2022 and 2026. 

10 [0009] The distance calculating unit 2015 calculates 
the mutual distance d from the position information 
received from the internal buses 2021, 202S and 2029. 
By comparing the calculated distance d with the depth L 
of a virtual space, if 0 <d S L / 4 , the value 4 ts given 

is and transferred to the video thinning fate determining 
unit 2017 via internal bus 2031. If l/<d£L/2, a 
value 2 is given. ifL/2<d*3L/4,a value 2 is given, 
and if 3 L / 4 s d 5 L , a value 1 is given, and these val- 
ues are transferred to the video thinning rate deter min- 

20 ing unit 20 1 7 via internal bus 203 1 . 

[001 0] The visual axis matching calculating unit 20 1 6 m ( 
calculates the cross angle ft between the visual axes of 
the users according to the position information recetved 
via internal buses 2021. 2025 and 2029. If the visual 

25 field of one user overlaps with that of another at a par- 
ticular terminal, the user is assigned with a value 3. and 
the value 3 is transferred to the video thinning rate 
determining unit 2017. If the visual field does not over* 
lap and 0 < 0 £ 45°, a value 2 is assigned, if 45° < e £ 

20 90°, a value 1 is assigned, and if 90 ft < e 5 180° a value 
0 is assigned, and these values are transferred to the 
video thinning rate determining unit 201 7. 
[001 1 1 The video thinning rate determining unit 201 7 
calculates a product of d and 9 for each user. Based on 

35 the calculated product, the transmission bit rate distribu- 
tion to the respective user's terminal is determined by 
proportional distribution so that their total amount is 64 
kbit / second. The determined transmission bit rate dis- 
tributions is transferred to the video thinning/ distributing 

40 unit 201 8 via internal bus 2033. * 
[001 2] The video thinning/ distributing unit 2018 thins 
the video received from the internal buses 2023 apd 
2027. and transmits the result to the internal bus 2020 
based on the transmission bit rate distribution received 

45 from the video thinning rate determining unit 2017 via 
internal bus 2033. The video thinning/ distributing unit 
2018 does the same for the video received from 2019 
and 2027. and transmits the result to the internal bus 
2024. and does the same for the video received form 

so the internal buses 2019 and 2023, and transmits the 
result to the internal bus 2028. 
[001 3] The thinning process carries out to reduce the 
frame numbers per second, or to reduce the resolution, 
or to reduce both. The line interface units 2011. 2012 

55 and 2013 transmit the videos received from the internal 
busses 2020, 2024 and 2028 to the lines 2034, 2035 
and 2036, respectively 

[0014] The network connection in this virtual three 
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dimensional space sharing device is a siar Type connec- 
tion, which ts illustrated in FIG. 20. The arrangement of 
F[G. 20 includes terminals 2101. a video server 2103. a 
public network 2104 and lines 2105. The respective ter- 
minals 2101 and the video server 2103 are all con- 5 
nected to the public network (INS64) via the lines 2105, 
and the information of a virtual three dimensional space 
is transmitted from the video server 2103 to the respec- 
tive terminals 2101. In this context, the virtual space 
sharing device 20 10 of FIG. 1 9 corresponds to the video 10 
server 21 03 of FIG. 20. 

[0015] As explained above, a star type connection in 
the user environment is a prerequisite for the conven- 
tional virtual three dimensional space sharing system. 
Thus, in a complex network environment where wide- 15 
band high-speed network and low-speed narrow-band 
network co-exist, it has been very difficult to provide effi- 
cient services to both terminal devices connected to the 
wide-band high-speea network and the narrow-band 
low-speed network at the same time. 30 
[0016] In addition, because the rendering functions 
which are used in the respective terminal devices are 
not taken into account, the information is uniformly 
transmitted to all of the users, even when there exists 
significant differences of the frame rates, number of 2s 
colors and resolution between the respective terminals. 
[0017] Moreover, the conventional device coutd not 
efficiently use the network bandwidth when varieties of 
media other than video such as computer graphics, live 
sound, voice and pre-recorded sound are provided. 20 
[0018] Furthermore, the users could not control the 
Quality of information regarding a virtual three dimen- 
sional space, even when the quality deterioration is 
caused by the limitations of communication bandwidth. 
[0019] Still further because the conventional device 35 
only relates the information transmission from the video 
server side to the user terminal device side, there is no 
way to prevent the congestion which might occur in the 
network when number of messages increases to 
change the objects in the virtual space in response to 40 
the user terminal devices. 

SUMMARY OF THE INVENTION 

[0020] It is an object of the present invention to pro- 46 
vjdes a virtual three dimensional space snaring system 
wherein the user terminal devices connected to the 
wide-band/ high-speed network effectively share high- 
quality virtual three dimensional space and perform 
multicast communication therebetween, taking advan- so 
taga of the wide bandwidth and high-speed, and at the 
same time, the user terminal devices connected to the 
narrow-band/low-speed network share a reasonable 
quality virtual three dimensional space and perform uni- 
cast communication therebetween, according to the ss 
bandwidth and speed of the network. 
[0021 ] It is another object of the present invention to 
provide a virtual three dimensional space sharing sys- 



tem which is able to reduce the number of the sound 
message, and to avoid congestion of the narrow- 
band/low-speed network. 

[0022] It is a further object of the present invention to 
provide a virtual three dimensional space sharing sys- 
tem which is able to reduce necessary communication 
messages and to avoid the congestion of the narrow- 
band/low*speed network without deteriorating the infor- 
mation quality. 

[0023] It is a still further object of the present invention 
to provide a virtual three dimensional space sharing 
system in which it is possible to automatically adjust the 
message communication, and to provide an effective 
virtual three dimensional space sharing device. 
[0024] It is a further object of the present invention to 
provide a virtual three dimensional space sharing sys- 
tem in which it is no longer necessary to perform mes- 
sage reduction each time, and in which is possible to 
improve the overall processing speed and to reduce the 
number of voice messages at the same time. 
[0025] It is a further object of the present invention to 
provide a virtual three dimensional space sharing sys- 
tem in which it is possible to obtain information regard- 
ing the virtual three dimensional space closer to 
information that the user desired. 
[0026] It is a further object of the present invention to 
provide a virtual three dimensional space sharing sys- 
tem in which it is possible to reduce the size of the mes- 
sages corresponding to a background sound which is 
the same for the second time and thereafter, and to 
reduce the network communication traffic. 
[0027] It is a further object of the present invention to 
provide a virtual three dimensional space sharing sys- 
tem in which it is possible not to transmit the messages 
relating to the slight movement of the objects, which 
other users would hardly notice, in order to reduce 
undesired. network communication traffic. 
[0028] According to an aspect of the invention, a vir- 
tual three dimensional space sharing system operating 
in a wide-area network environment having both a wide- 
band/ high-speed network provided with user terminal 
devices and a narrow-band/low-speed network pro- 
vided with user terminal devices, for sharing a virtual 
three dimensional space comprised of a plurality of 
media among the user terminal devices includes, (a) a 
multicast message transmitting unit and a multicast 
message receiving unit for performing multicast com- 
munication with the wide-band/ high-speed network (b) 
a unicast message transmitting unit and a unicast mes- 
sage receiving unit for performing unicast communica- 
tion with the narrow-band/low-speed network; (c) a 
multicast group managing unit, a unicast message gen- 
erating unit and a multicast message generating unit, for 
coordinating the multicast communication and the uni- 
cast communication; and (d) a message thinning/ re- 
assembling unit for reducing the communication traffic 
in the narrow-band/low-speed network. 
[0029] According to another aspect of the invention, in 
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the virtual three dimensional space sharing system, the 
message thinning/ re-assembling unit mixes and com- 
presses a plurality of sound messages which are trans- 
mitted from the user terminal devices into one message. 
[0030] According to a further aspect of the invention. s 
in the virtual thtee dimensional space sharing device, 
the message thinning/ re-assembling unit reduces and 
re-assembles the messages based on the visual field 
range and visual field angle parameter of me video 
object placed in the virtual three dimensional space, jo 
based on a communication load measurement. 
10031] According to a still further aspect of the inven- 
tion, in the virtual three dimensional space sharing sys- 
tem, each user terminal device connected to the 
narrow-band/low-speed network includes a communi- is 
cation delay measuring unit for measuring a delay time 
to/from the virtual three dimensional space sharing 
device, the communication delay measuring unit sets 
and changes an auditory parameter defined by the vis- 
ual field and visual field angle parameter toward the 20 
video object placed in the virtual three dimensional 
space or distance from the sound object, based on a 
communication load measurement 
[0032] According to a further aspect of the invention, 
in the virtual three dimensional space sharing device, 2s 
the message thinning/ re-assembllng unit includes a 
background sound managing unit for managing the 
recorded background for each direction, the back- 
ground sound managing unit calculates the direction of 
the background sound based on the position and the 30 
sound volume of a sound object, and transfers the cor- 
responding background sound to the terminal devices. 
[0033] According to a further aspect of the invention, 
the virtual three dimensional space sharing system fur- 
ther includes a message distribution determining unit for 35 
controlling the sense balance of the auditory sense and 
visual sense of the sound objects and the video objects, 
which includes the updated virtual space on the user 
terminal devices, and the message distribution deter- 
mining unit distributes the messages received from the 40 
user terminal devices to the sound objects and the 
video objects based on the sense parameters. 
[0034] According to a further aspect of the invention, 
in the virtual three dimensional space sharing system, 
the message thinning/ reassembling unit includes a 4S 
transmitted data managing unit for managing the back- 
ground sounds which have been already transmitted, 
the message thinning/ re-assembling unit transmits only 
identifiers, stored in the transmitted data managing unit, 
corresponding to the background sounds to the same so 
user terminal, if the background sounds have been 
already transmitted: the user terminals include a 
received data managing unit for storing the received 
background sounds, and the message thinning/reas- 
sembling unit takes out and processes the correspond- ss 
ing background data from the received data managing 
unit, if the identifier corresponding to the background 
sounds are received. 
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[0035] According to a further aspect of the invention, 
in the virtual three dimensional space sharing system, 
the user terminal devices include a virtual space infor- 
mation update examining unit, the virtual space infor- 
mation update examining unit transmits a message 
indicating that the state of the video object exceeds a 
predetermined threshold, only when the state of the 
video object comprising the virtual three dimensional 
space exceeds a predetermined threshold. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0036] The present invention will become more fully 
understood by the accompanying drawings which are 
given by way of illustration only, and thus are not limita- 
tive of the present invention, and wherein: 

FIG. 1 illustrates a virtual three dimensional space 
sharing system for a large wide-area network envi- 
ronment according to a first embodiment of the 
present invention; 

FIG. 2 is a flowchart showing the initializing opera- 
tion of the virtual three dimensional space sharing 
system for a large wide-area network environment 
according to the first embodiment of the present 
invention; 

FIG, 3 is a flowchart showing processes when the 
virtual three dimensional space sharing device for 
the wide-area network environment according to 
the first embodiment receives a message from the 
narrow-band/ low-speed network; 
FIG. 4 is a flowchart showing processes when the 
virtual three dimensional space sharing device for 
the wide-area network environment according to 
the first embodiment receives a message from the 
wide-band/ high-speed network; 
FIG. 5 illustrates a message thinning/ re-assem- 
bhng unit of the virtual three dimensional space 
sharing device for the wide-area network environ- 
ment according to the first embodiment of the 
present invention; 

FIG. 6 is a flowchart illustrating the message thin- 
ning processes in the first embodiment of the 
present invention: 

FIG. 7 illustrates a user terminal device which is 
connected to the wide-band / high-speed network 
according to the first embodiment of the present 
invention; 

FIG. 8 illustrates a user terminal device which is 
connected to the narrow-band /low-speed network 
according to the first embodiment of the present 
invention; 

FIG. 9 illustrates a message thinning/re-assembling 
unit according to a second embodiment of the 
present invention: 

FIG. 10 explains information regarding the avatar of 
a user; 

FIG. 1 1 illustrates a message thinning/re-assem- 
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bling unit according to a third embodiment of the 
present invention; 

F|G. 12 illustrates a user terminal device which is 
connected to the narrow-band/low-speed network 
according to a fourth embodiment of the present 
invention; 

FIG. 13 illustrates a message thinning/ re-assem- 
bling unit according to a fifth embodiment of the 
present invention; 

FIG. 14 illustrates a user terminal device according 
to a sixth embodiment of the present invention; 
FIG. 15 illustrates a message thinning/ re-assem- 
bling unit according to the sixth embodiment of the 
present invention; 

FIG. 16 illustrates a message thinning/ re-assem- 
bling unit according to a seventh embodiment of the 
present invention; 

FIG. 17 illustrates a user terminal device according 
to the seventh embodiment of the present inven- 
tion; 

( FIG. 18 is a flowchart illustrating an operation of a 

virtual space information update examining unit 
according to an eighth embodiment of the present 
invention; 

FIG. 19 illustrates a conventional virtual three 
dimensional space sharing device; and 
FIG. 20 illustrates the network connection of the 
conventional virtual three dimensional space shar- 
ing device. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0037] Further scope of applicability of the present 
invention will become apparent from the detailed 
description given hereinafter. However, it should be 
understood that the detailed description and specific 
examples, while indicating preferred embodiments of 
the invention, are given by way of illustration only, since 
( various changes and modifications within the spirit and 

scope of the invention will become apparent to those 
skilled in the art from this detailed description. 

Embodiment 1. 

[0038] A first embodiment of the present invention is 
explained using FIGS. 1 - 8. F|G. 1 shows a virtual three 
dimensional space sharing system for a large wide-area 
network environment of the first embodiment. The 
arrangement of FIG. 1 includes a wide-fcand/high- speed 
network 101, user terminal devices 1Q2 connected to 
the wide-band/ high-speed network 101, a narrow- 
band/ iow-speed network 103, user terminal devices 

104 connected to the narrow-band/low- speed network 
and a virtual three dimensional space sharing device 

105 for a large wide-area network environment. 
[0039] In addition, the virtual three dimensional space 
sharing device 105 for a large wide-area includes a uni- 
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cast message generating unit 106. a multicast group 
managing unit 107, a multicast message receiving unit 
108, a unicast message receiving unit 109, a multicast 
message generating unit 110, a multicast message 
5 transmitting unit 1 1 1 . a unicast message transmitting 
unit 112. and a message thinning/ re-as6embling unit 
113. 

[0040] Next, the initializing operation of the virtual 
three dimensional space sharing device 105 is 
w explained below using the flowchart of FIG. 2. First, the 
device starts processing at a step S001, and waits for 
participation demand messages received from the user 
PC. at ports of the unicast message receiving unit 1 06 
and the multicast message receiving unit 108 (step 
rs S002). 

[0041] The participation demand message contains at 
least an address of the user terminal device, a name of 
a virtual three dimensional space to which the user is 
going to participate, available bandwidth of the network 
20 to which the user terminal device is connected, and 
information display frame rate information on the user 
terminal device. 

[0042] Upon receiving the participation demand mes- 
sage, the device assigns the initializing processes. 
2S according to whether the message is received from the 
user terminal device 104 on the narrow-band/ low- 
speed network 103, or from the user terminal device 
102 on the wide-band/ high-speed network 101 (step 
S003). 

30 [0043] If the message is received from the narrow- 
band/ low-speed network 103, the unicast message 
receiving unit 106 receives the participation demand 
message (step S004), assigns the multicast group cor- 
responding to the name of the three dimensional space. 
J5 to which thjs user is going to participate, contained in 
the message. Then, the unicast message receiving unit 
106 registers the address of the user and the corre- 
sponding multicast group to the multicast group manag- 
ing unit 107 (step S005). 
40 [0004] In the same manner, for the information display 
frame rate, the unicast message receiving unit 106 reg- 
isters the number of colors and resolution of the user 
terminal device, and the bandwidth of the using net- 
work, which are contained in the participation demand 
45 message, to the message thinning/ re-assembling unit 
113 (step S006). 

[0045] Furthermore, the multicast message generat- 
ing unit 1 10 generates a multicast message, addressed 
to the above-described multicast group, from this partic- 
so ipation demand message (step S007), and transmits 
the multicast message to the wide-band/ high-speed 
network via the multicast message transmitting unit 1 1 1 
(step So 08). The initialization based on the participation 
demand message transmitted from the narrow- 
ss band/low- speed network is completed in this manner 
(step S009). 

[0046] On the contrary, the multicast message receiv- 
ing unit 108 receives the participation demand message 
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from the wide-band/ high-speed network 101 as a mul- 
ticast message (step S010). The multicast message 
receiving unit 108 registers the multicast group to which 
This message belongs to the multicast group managing 
unit 107 (step S01 1). If there is a use' terminal device 
(104) on the narrow-band/low-speed network 103 side 
(step S012), the unicast message receiving unit 109 
generates unicast messages from this message for 
every address of the terminal devices belonging to the 
multicast group, and delivers the generated unicast 
messages to the message thinning/ re-assembling unit 
113 (step S013). 

f0047J The message thinning/ re- assembling unit 1 1 3 
re-assembles messages addressed to an identical host 
(user terminal device) into one message, transmits the 
message to the narrow-band/ low-speed network 103 
side via the unicast message transmitting unit 112 (step 
S0 15), and completes the initialization process (step 
S009). 

[0048] Next, processes are explained below for a case 
when a message is received from the narrow-band/low* 
speed network using the flowchart of FIG. 3 in the three 
dimensional space sharing state after the device initiali- 
zation. 

[0049] After the initialization of the virtual three dimen- 
sional space sharing device is completed, the process 
goes to the virtual three dimensional space sharing 
state (step S021). The unicast message receiving unit 
106 examines the receiving port until a message arrives 
from a user terminal device 104 which is connected to 
the narrow-band/ low-speed network 1 03 (step S022). 
Once a message arrives, the unicast message receiv- 
ing unit 106 receives the message(step S023), and 
transmits the message to the multicast message gener- 
ating unit 1 10 and the message thinning/ re-assembling 
unit 113. 

[0050] The multicast message generating unit 110 
converts the received message into a multicast mes- 
sage which ts addressed to the multicast address con- 
tained in the received message (6tep S024), and 
delivers the converted message to the multicast mes- 
sage transmitting unit 111. The multicast message 
transmitting unit 1 1 1 transmits this multicast message 
to the wide-band/ high-speed network 101 (step S025). 
[0051 ] The message thinning/ re-assembling unit 1 1 3 
queries the multicast group managing unit 107 whether 
there is a user terminal device 104 which is connected 
to the narrow-band/low-speed network, belonging to the 
same multicast group (step S026) as that of the 
received message. If there is no corresponding user ter- 
minal device i04, the message thinning/ re-assembling 
unit 1 13 discards this message, and the process returns 
to The step S022. it there is a corresponding user terrrn. 
nal device 104, the message thinning/ re-assembling 
unit 1 13 thins the message based on the frame rate and 
network bandwidth, which is managed for the respective 
user terminals, and re-assembles it into a unicast mes- 
sage addressed to the respective terminal devices (step 



10 

S027), and delivers this unicast message to the unicast 
message transmitting unit 1 12. 
[0052] The unicast message transmitting unit 112 
transmits th's message to the destination user terminal 

s device 104 via the narrow-band/low-speed network 1 03 
using the unicast communication (step S028). Then, the 
processes of the above steps S022-S028 are repeated. 
[0053] Next, processes are explained below for a case 
when a message is received from the wide-band/ high- 

10 speed network using the flowchart of FIG. 4 in the three 
dimensional space sharing state after the device initiali- 
zation. 

[0054] After the initialization of the virtual three dimen- 
sional space sharing device is completed, the device 

is goes to the virtual three dimensional space sharing 
state (step S041). The multicast message receiving unit 
108 examines the receiving port until a message arrives 
from a user terminal device 102 which is connected to 
the wide-band/hjgh-speed network 101 (step S042). 

20 Once the message arrives, the multicast message 
receiving unit 108 receives the message (step S043), 
and transmits it to the unicast message receiving unit 
109. 

[0055] The unicast message receiving unit 109 que* 

25 r»es the multicast group managing unit 107 whether a 
user terminal device, corresponding to the multicast 
group to which the message belongs, exists on the nar- 
row-band/low-speed network side (step S044). If there 
is no corresponding user terminal, the unicast message 

30 receiving unit 1 09 discards this message, and the proc- 
ess returns to the step S042. If there is a corresponding 
user terminal, the unicast message receiving unit 109 
generates a unicast message for each address of the 
respective corresponding user terminal device, and 

3s sends the unicast messages to the message thinning/ 
re-assembling unit 1 13. The message thinning/ re- 
assembling unit 113 thins the message based on the 
frame rate and network bandwidth, which is managed 
for the respective user terminals, and re-assembles it 

40 into a unicast message addressed to the respective ter- 
minal devices (step S046). and delivers this unicast 
message to the unicast message transmitting unit 112. 
[0056] The unicast massage transmitting unit 112 
transmits this message to the destination user terminal 

45 device 104 via the corresponding narrow-band/low- 
speed network 103. using the unicast communication 
(step S047). Then, the processes of the above steps 
S042-S047 are repeated. 

[0057] The message thinning/ reassembling unit 113 
so is explained in detail using flowcharts of FIG. 5 and FIG. 
6, respectively. The arrangement of FIG. 5 includes a 
message receiving unit 121, an address analyzing unit 
122, a message type judging unit 123, a frame rate / 
bandwidth managing unit 124, a timer 125, a message 
55 hold-updating unit 126, a resolution reducing unit 12, a 
compressing unit 128 and message delivery unit 129. 
[0058] Before explaining the operation, three data cat- 
egories defining the virtual three dimensional space are 
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discussed. 

(1) Category A: This category includes object data 
regarding avatar shape, absolute position, colors 
and si2e of the avatar of a user, or shape, absolute 
position, colors and si2e of moving shared object 
(s). in the virtual three dimensional space where 
information at a certain time is not influenced by 
information prior to the time. 

(2) Category B ; This category includes object data 
regarding live video, or recorded VTR video, where 
information is provided per a frame unit; 

(3) Category C ; This category includes object data 
regarding live voice or live sound which do not 
make sense unless they are continuous. 

[0053] In FIG. 5 and FIG. 6. once the message thin- 
ning/ re-assembling unit 1 13 starts its operation (step 
S061), the message receiving unit 122 receives a uni- 
cast message from either the unicast message receiv- 
( ing unit 106, or the unicast message generating unit 1 09 

(step S062). 

[0060] Then, the address analyzing unit 122 looks up 
the destination address of the received message, and 
carries out subsequent steps S064 - S074 according to 
corresponding destination address. 
[0061] The timer 125 records current time (step 
S064), and the message type judging unit 123 exam- 
ines the type of message (step S065). If the message 
contains data of category A. the following process A is 
performed, if the message contains data of category B, 
the following process B is performed, and if the mes- 
sage contains data of category C. the following process 
C is performed. 

(1) Process A: Using time recorded by the message 
hold-updating unit 126 in the step S064, and a 
flame rate corresponding to the terminal device 
which correspond to the address registered in the 
( frame rate / bandwidth managing unit 1 24 at initial- 

ization, it is examined whether the time for one 
frame corresponding the terminal device has 
passed (step S066). 

If the time for one frame has passed, the mes- 
sage delivery unit 129 delivers the message to the 
unicast message transmitting unit 112, and con- 
firms if there is a stored message (step S071). If 
there is a stored message, the message delivery 
unit 129 discards the stored message (step S072), 
and the process returns to the step S062 so as to 
receive the next message. 

If the time for one flame has not yet passed, the 
message delivery unit 129 examines whether there 
is any stored message regarding the same object 
(step S067). If no message is stored, the message 
delivery unit 129 stores the current message (step 
S068), and the process returns to the step S062 so 
as to receive the next message. If there is a stored 
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message, the message delivery unit 129 replaces 
the stored message with the current message (step 
S069), and the process returns to the step S062 so 
as to receive the next message. 
5 (2) Process B : The resolution reducing unit 127 

reduces the resolution of the image so that the 
image is contained within the number of colors, res- 
olution and bandwidth stored in the frame rate / 
bandwidth managing unit 124, and re- assembles 
10 the reduced message (step $073), and delivers the 
reduced message to the unicast message transmit* 
ting unit 112 via the message delivery unit 129 
(step S070). In the step $071, because there is no 
any stored message, the process returns to the 
ts step S062. 

(3) Process C : The compressing unit 128 com- 
presses the data by deteriorating the data quality, 
so that the image is contained within the bandwidth 
of image stored in the frame rate / bandwidth man- 
20 aging unit 124 (step S074). The compressed mes- 
sage is delivered to the unicast message 
transmitting unit 112 via the message delivery unit 
129 (step S070). In the step S071 . because there is 
no stored message, the process returns to the step 
2S S062. 

[0062] When the frame rate of the user terminal 
device is sufficiently low compared with the frame rates 
of the other terminal devices, it is also possible to apply 

30 the process A for the category B data. 

[00S3I The user terminal device 102 connected to the 
■ wide-band/ high-speed network and the user terminal 
device 104 connected to the narrow-band/low-speed 
network are explained below using FIG. 7 and FIG. 8. 

35 respectively. 

[0064] FIG. 7 illustrates the user terminal device 102 
connected to the wide-band/ high-speed network. The 
arrangement of FIG. 7 includes a virtual space informa- 
tion storage managing unit 141, respective objects 142 

40 in the virtual space belonging to the above-explained 
category A. category B and category C. respectively, a 
multicast message receiving unit 143, a virtual space 
information updating unit 144, a virtual space informa- 
tion accessing unit 145. a virtual space information dis- 

4S playing unit 146. a virtual space information operating 
unit 147, a virtual space information update examining 
unit 148 and a multicast message transmitting unit U9. 
[0065] The user terminal 102 shares a virtual three 
dimensional space using multicast by mutually commu- 

so nicating the information regarding the objects 142 in the 
virtual three dimensional space, between other user ter- 
minals 102 and virtual three dimensional space sharing 
device 105. 

[0066] The multicast message receiving unit 143 
55 receives a multicast message from the wide-band/high- 
speed network 101. and the virtual space information 
updating unit 144 registers the information regarding 
the objects 142 in the virtual space contained in the 
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message into the virtual space information managing 
unit 141. and updates it. 

[0067] The state of the three dimensions! space is 
given to the virtual space information displaying unit 146 
via the virtual space information accessing unit 143. s 
The virtual space information displaying unit 146 t then, 
concretely displays the information of the virtual three 
dimensional space to the users by rendering the virtual 
three dimensional space so that the human* sense 
organs such as visual, auditory, force and smell infer- to 
mation can understand it. 

[0068] The user manipulates the objects in the virtual 
three dimensional space via input equipment such as a 
mouse, keyboard and track ball, or via a virtual space 
information operating a unit 147 which corresponds to »5 
an application program describing the various opera- 
tions on the objects. These manipulations are reflected 
to the virtual space objects 142 in the virtual space 
information storage managing unit 141 via the virtual 
space information accessing unit 1 45. & 
[0069] When the state of the objects 1 42 in the virtual 
space is changed by such manipulation, the virtual 
space Information update examining unit 148 detects 
this change, and transmits the changed contents to the 
wide-band/ high-speed network 101 via the multicast 2S 
message transmitting unit 149. By performing the series 
of the operations explained above, the respective users 
interact with the virtual three dimensional space. 
[0070] FIG. 8 shows a user terminal device 104 con- 
nected to the narrow-band/low-speed network. The jo 
arrangement of FIG. B includes a unicast message 
receiving unit 151 and a unicast message transmitting 
unit 152. 

[0071] " The user terminal device 104 connected to the 
narrow-band/low-speed network 103 operates in the as 
same manner as the user terminal device 102 con- 
nected to the wide -band/high-speed network 101 . How- 
ever, the user terminal device 104 is different from the 
user terminal device 102, in that the user terminal 
device 104 communicates with the three dimensional <c 
space sharing device 105 only by the unicast. using the 
unicast message receiving unit 151 and the unicast 
message transmission unit 1S2 via the narrow- 
band/low-speed network 103. According to the above 
operation, the virtual three dimensional space can be <f 
shared. 

[0072] As explained above, in the firs; embodiment of 
the present invention, for communication which shares 
the virtual three dimensional 6pace. the user devices 
which are connected to the wide-band high-speed net* so 
work can communicate by the multicast communication. 
For the user devices which are connected to the narrow* 
band/low-speed network, the virtual Three dimensional 
space sharing device reduces the message according 
to the narrow bandwidth, and effectively reduces the 55 
message according to the flame rate, number of colors 
and resolution of the terminal devices. As a result, it is 
possible to 6hare the virtual three dimensional space 



with sufficiently high quality by taking advantage of its 
bandwidth and the high speed, between the terminal 
devices connected to the wide -band/high-speed net- 
work, and at the same time for the terminal devices con- 
nected to the narrow'band/low-speed network, it is 
possible to share the virtual three dimensional space 
with the quality corresponding to the bandwidth and 
speed of the network. 

[0073J in addition, the communication can be effec- 
tively performed for each media, even when a plurality 
of media other than the video are shared in the virtual 
three dimensional space. 

[0074] By dividing the virtual space into a plurality of 
logical spaces and assigning the respective logical 
spaces to separate multicast groups, only the neces- 
sary information is communicated using the corre- 
sponding multicast groups. Therefore, the unicast 
communication between the virtual space sharing 
device connected to the narrow-band/ low-speed net- 
work can be interacted with the multicast communica- 
tion between the virtual space sharing device 
connected to the wide-band/high-speed network. Fur- 
ther, in an LAN environment system using communica- 
tion reducing technology, it is possible to share the 
virtual three dimensional space by dial-up IP connection 
to this virtual three dimensional space sharing device 
using simple protocols such as SLP and PPP 

Embodiments 

[0075] Next, a second embodiment of the present 
invention is explained below using FIG. 9. In the above 
first embodiment the communication traffic is reduced 
between the user terminal devices connected to the 
wide-band/high-speed network by using multicast com- 
munication, and the communication traffic is reduced 
between the user terminal devices connected to the 
narrow-band/low-speed network by thinning the mes- 
sages according to the message types. The second 
embodiment relates to avoiding the congestion of the 
narrow-band/ low-speed network in a situation where 
sound streams are received from many user terminal 
devices. 

[0076] FIG. 9 illustrates the arrangement of a mes- 
sage thinning/ re-assembling unit 113 according to a 
second embodiment of the present invention. The 
arrangement of FIG. 9 includes a sound message man- 
aging unit 161. a sound buffer 162 and a sound mixing 
unit 163. 

[0077] Next, the operation of the second embodiment 
of the present invention is explained below using FIG. 9. 
For the data of category A and category B, which are 
explained above for the first embodiment, the message 
thinning/ re-assembling unit 113 operates in the same 
manner as that in the first embodiment. 
[0078] For the data of category C. the sound message 
managing unit 161 temporarily stores the plurality of 
messages transmitted from the plurality of terminal 
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devices to the sound buffer 1 62 tor the same frame time. 
Then, the sound mixing unit 1 63 mixes and synthesizes 
the sound data contained in a plurality of messages for 
each frame into one sound data. The compressing unit 
128 compresses this data to generate a new com- 
pressed unicast message. This compressed unicast 
message is delivered to the unicast message transmit- 
ting unit 1 12 via the message delivery unit 129. 
[0079] As explained above, in the second embodiment 
of the present invention, the virtual three dimensional 
space sharing device mixes the sound messages trans- 
mined from the plurality of terminal devices into one 
message, and this message is further compressed. 
Therefore, it is possible to reduce the number of the 
sound messages, and to avoid the congestion of the 
narrow-band/low-speed network. 

E mbodiment 3. 

[0080] Next a third embodiment of the present inven- 
tion is explained below using FiG. 1 0 and FIG. 1 1 . In the 
above embodiments, the number of messages are 
reduced based on the frame rate of the user terminal 
devices and the network bandwidth to avoid congestion 
of the network. In the third embodiment, congestion of 
the network is avoided by using the information regard- 
ing the avatars of the users. 

[0081] Generally, the users who share a virtual three 
dimensional space put themselves in the space by their 
avatars displayed by three dimensional computer 
graphics. The information of the virtual three dimen- 
sional space are provided to all users in the manner that 
the visual organ or auditory organ of the user would be 
located in a specific position. At this time, the informa- 
tion regarding the avatar of the user is provided at feast 
a part of or all of that Plustrated in FIG. 10. 
[0082] In FIG. 1 0. the position of the avatar of the user 
on the coordinate is indicated by P (Px. Py. Pz), the face 
direction of the avatar is indicated by a unit vector F, and 
the direction of the avatar's gaze is indicated by a unit 
vector G. The angle of the visual field of the avatar is 
indicated as a, the nearest distance that the user can 
recogn^e an object is indicated as Smin, and the far- 
thest distance that the user can recognize an object is 
indicated as Smax. The nearest spherical radius of the 
audible area that the user can recognize the sound 
source is indicated as Hmin. and the farthest spherical 
radius of the audible area that the user cannot recog- 
nize the sound source but can recognize the back- 
ground sound is indicated as Hmax. The direction of G 
does not necessarily match the direction of F 
[0083] In the third embodiment, the message thinning/ 
re-assembling unit 113 is arranged in the manner 
shown in FIG. 1 1. The arrangement of FIG. 1 1 includes 
a user avatar information managing unit 171- This user 
avatar information managing unit collects and stores 
each of the above information regarding the avatar of 
the user through communication with the user terminal 



device. 

[0084] Once the message receiving unit 121 receives 
a message either from the unicast message receiving 
unit 106 or from the unicast message generator 109. the 

s address analyzing unit 122 examines the destination 
address of this message, and takes out the information 
regarding the avatar of the user corresponding to this 
destination address from the user avatar Information 
managing unit 1 71 . 

to [0085] The message is thinned and re-assembled for 
each category of the message in the same manner as in 
the first or second embodiment If the message is of cat- 
egory A or category B. the message is processed only 
when the position of the object contained in this mes- 

i5 sage exists within the visual field expressed by P, G and 
a, at the same time within the area of Smin and Smax. 
if the object exists outside this area, this message is dis- 
carded. 

[0086] if the message is of category C and the posi- 
20 tion of the sound source of the message exists within 
the area of Hmin. the respective messages are com- 
pressed, without mixing the sounds of the plurality of 
messages. If the sound source of the message exists 
between Hmm and Hmax. the sounds are mixed, and 
25 then compressed. If the sound source of the message 
exists outside Hmax, this message is discarded without 
being processed. 

[0087] In the manner explained above, in the third 
embodiment of the present invention, unnecessary 

3Q communication is avoided by communicating only the 
information within an appropriate distance from the 
position of the avatar of the user, out of the entire infor- 
mation regarding the virtual three dimensional space. In 
this way, it is possible to avoid congestion of the narrow- 

35 band/low-speed network without deteriorating the qual- 
ity of the information. 

Emfrq^ent 4. 

40 [0088] A fourth embodiment of the present invention 
is explained below using FIG. 12. In contrast to the third 
embodiment in the fourth embodiment the thinning 
and the re-assembly of the message is controlled 
according to the communication state between the user 

4$ terminals and the virtual three dimensional space shar- 
ing device, and the load state of the virtual three dimen- 
sional space shanng device. 

[0089] FIG. 12 illustrates an arrangement of a user 
terminal device which is connected to the narrow- 
so band/low-speed network of the fourth embodiment. The 
arrangement of FIG. 1 2 includes a communication delay 
measuring unit 181, a avatar sense parameter setting 
unit 182 and a timer 183. 

[0090] Next, the operation is explained below. In the 
55 user terminal device 104. the communication delay 
measuring unit 181 periodically obtains the current time 
TO using the timer 183 during communication with the 
virtual three dimensional space, and transmits a round 
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trip message (or measuring the communication delay to 
the virtual thiee dimensional space sharing device 105 
via narrow-band/|ow-speed network 103, using the uni- 
cast message transmitting unit 152. 
[0091] Upon receiving this communication delay 
measuring message, the virtual three dimensional 
space sharing device 105 returns back the acknowl- 
edged message added with the load average L of the 
current virtual three dimensional space sharing device 
to the message source. 

[0092] The unicast message receiving unit 1S1 
receives this acknowledged message, and delivers it to 
the comrnunication delay measuring unit 181. The com- 
munication delay measuring unit 181 obtains the cur- 
rent time T1 from the timer 1 83, and sets the value (T1 - 
T0)/2 as a communication delay D. Furthermore, the 
communication delay measuring unit 181 takes out the 
load average L of the virtual three dimensional space 
sharing device from the message, and delivers D and L 
to the avatar 6ense parameter setting unit 182 
[0093] The avatar sense parameter setting unit 182 
sets the angle of the visual field parameter a. the visual 
field parameter Smax. the sound source area parame- 
ter Hmax out of the above avatar information parame- 
ters, according to the following equations. 

a=aO - (1 +{DO-D)/D0+(LO-L)/L) 

Smax = SO - (1 +(D0-D)/D0+(L0-L)/L) 

Hmax=H0 - (1+(D0-O)/D0+(L0-L)/L) 

where. aO, SO and ho are the respective default values 
of a, Smax and Hmax, respectively, and DO and U> indi- 
cate the initial values of 0 and L. respectively. According 
to these equations, the angle of the visual field a, the 
visual field Smax, the sound source area Hmax of the 
avatar of the user is narrowed under the situation in 
which the load of the virtual three dimensional space 
sharing system is high, or the communication delay 
from the virtual three dimensional space sharing device 
is large. 

[0094] It should be noted that, in this example, the val- 
ues of a, Smax and Hmax are adjusted according to the 
equations above, but it is also possible to control these 
values using only D and L. or to control a, Smax and 
Hmax using other equations so that a. Smax and Hmax 
are reduced when D or L increases. In addition, it is also 
possible to perform similar kinds of control on Smin and 
Hrnin. 

[0095] According to the user terminal device of the 
fourth embodiment. It is possible to automatically con- 
trol the communication traffic of the messages accord- 
ing to the load state of the virtual three dimensional 
space or according to the communication state to/from 
the virtual three dimensional space. In this manner, it is 
possible to provide an effective virtual three dimensional 
space sharing device. 



Pgho^jpnent 5. 

[0096] A fifth embodiment of the present invention is 
explained below using FIG. 13. in the fifth embodiment, 

5 when the voice messages are transmitted from many 
user terminal devices, communication traffic of the voice 
message is efficiently reduced without disturbing the 
users, the load of the virtual three dimensional space 
sharing device is reduced, and at the same time con- 

io gestion of the network is avoided. 

[0097] FIG. 13 illustrates a message thinning/ re- 
assembling unit of the virtual three dimensional space 
sharing device according to the fifth embodiment, and 
includes a background sound managing unit 191. The 

is background sound managing unit 191 stores, in a com- 
pressed from, the chat-sounds including the left side 
chat-sound, right side chat-sound, front side chat-sound 
and back side-chat sound, which pre-record the talking 
voices of a plurality of people located at the left side. 

20 right side, in front of, and at the back of the user, respec- 
tively. 

[0098] The message thinning/ re-assembling unit of 
the fifth embodiment operates in the same way for the 
data of category A and category 8 as in the third 

25 embodiment. The message thinning/ re-assembling unit 
1 13 operates as follows for the data of category C. First, 
upon receiving messages regarding a plurality of sound 
objects, if the received messages are the user's voice 
messages, the message thinning/ re-assembling unit 

30 113 takes out the coordinates of the sound source and 
the sound volume from the respective messages. The 
coordinate indicating the position of the sound source is 
indicated a6 Ps [i], and the sound volume is indicated as 
V [i] for the i-th message, respectively. The background 

35 sound managing unit obtains vector Q [0 which directs 
from P to Ps [i] for the coordinate P of the user who 
receives these voice messages. Only messages whose 
magnitude is equal or more than Hrnin and equal or less 
than Hmax, Q[i] are summed with the weight of V[i] to 

40 obtain a summed vector. If the direction of this summed 
vector is withm the area of 90 degrees toward the front, 
in relation to the direction of the vector F. it «s assumed 
that the chat-sound is the front chat-sound. If the direc- 
tion of the summed vector is within the area of 90 

45 degrees toward the back in relation to the direction of 
the vector F, it is assumed that the chat-sound is the 
back chat-sound. If the direction is within the area of 90 
degrees in the right, it is assumed that the chat-sound is 
the right chat-sound, and if the direction is within the 

so area of 90 degrees in the left, it is assumed that the 
chat-sound is the left chat-sound. 
[0099] If the direction of the summed vector js just at 
90 degrees either in the front, or at the back, either the 
right side chat-sound or the left side chat-sound is cho- 

55 sen according to the nearest summed vector. This data 
is assembled into a unicast message toward the desti- 
nation user terminal device, and is delivered to the uni- 
cast message transmitting unit 112 via the message 
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delivery unit 129. 

[OlOO] According to the fifth embodiment it is not nec- 
essary to perform the processes in the sound misting 
unit 163 and compressing unit 128 each time a plurality 
of voice messages whose sound sources are within the 
area between Hmin and Hmax is received. Thus, the 
processing speed of the message thinning/ re-assem* 
bing unit can be improved, and at the same time the 
number of voice messages can be reduced. 

Embodiment 6. 

[0101] A sixth embodiment is explained below using 
FIGS. 14 and 15. The present embodiment relates to 
priority control of the messages which the user commu- 
nicates indirectly. FIG. 14 illustrates a user terminal 
device according to the sixth embodiment, and includes 
a avatar information managing unit 20 1 and a avatar 
information object 202. 

[0102] The avatar information managing unit 201 gen- 
< erates information regarding the avatar of the user as 

explained in the third embodiment when the user partic- 
ipates in the virtual three dimensional space, and gen- 
erates the avatar information object 202 in the virtual 
space information storage managing unit 14i as one 
kind of object in the virtual three dimensional space, via 
the virtual space information accessing unit 145. 
[01 OS] The virtual space information displaying unit 
146 displays this avatar information in the form illus- 
trated in FIG. 10 on the monitor of the user terminal 
device, The user dynamically changes the sense 
parameters of the avatar displayed on the monitor using 
the virtual space information operating unit 147. The 
avatar information managing unit 201 carries out the 
correction of the display using the virtual space informa- 
tion operating unit 147 and the virtual space information 
displaying unit 146 based on the changing demands. 
[0104] The avatar information managing unit 201 
obtains a ratio of the abject relating to the detail sound 
( in the current virtual three dimension space, and the 

object relating to graphic or image whose state is 
changed in the virtual three dimension space via the vir- 
tual space information accessing unit 145. For example, 
if the ratio of the object relating to the sound and the 
object relating to the image between the sense parame- 
ters of the avatar is P. a limitation requirement is given 
as follows. 

R=a ■ (Smax-Smin)/(Hmax-Hmin) 

[0105] This requirement is not necessarily limited to 
the above equation, but may be any equation which 
reflects the ratio between the sound information and the 
video information in the virtual space. The sense 
parameters by the user are limited by the avatar infor- 
mation managing unit 201 as in the above equation, and 
the sense parameters control the balance of the receiv- 
ing information regarding the auditory sense and the 
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visual sense. 

[0106] The avatar information managing unit 201 
updates the content of the avatar information object 202 
in the virtual space information storage managing unit 

5 141 vta the virtual space information accessing unit 
145. The virtual space information change examining 
unit 148 detects this update, and the unicast message 
transmission unit 1 52 transmits this updated information 
to the virtual three dimensional space sharing device 

10 105 via the narrow-band/low-speed network 103. 

[0107] FIG. 15 illustrates a message thinning/ re- 
assembling unit 113 according to the present embodi- 
ment. The arrangement of FIG. 15 includes a message 
distribution determining unit 211. Upon receiving the 

15 message regarding the above avatar information 
object, the message thinning/ re-assembling unit 113 
stores the content into the user avatar information 
managing unit 171. In processing the messages from 
the other user terminal devices, the message distri- 

20 bution determining unit 211 proportionally distributes 
the bandwidth, which is obtained from the frame rate / 
bandwidth managing unit 12* transmitted to the desti- 
nation terminal device, to the messages of category 
B and category C. using the sense parameter 

25 obtained from the user avatar information managing 
unit 171. according to the above limitation equation 
R = a - (Smax-Smin)/(Hmax-Hmin) . 
[0108] Based on this proportionally distributed band- 
width, the processes are performed for the messages of 

30 category B and category C in the same manner as that 
in the second embodiment. 

[0109] According to the above, it is possible for the 
user to assign the preferred priority distribution regard- 
ing the type and quality of the information, and to obtain 
35 the closer and desired information in the virtual three 
dimensional space. 

Embodiment 7. 

40 [0110] Next, a seventh embodiment of the present 
invention is explained below using FIGS. 16 and 17. In 
the seventh embodiment, the efficiency of message 
reduction method of the fifth embodiment is improved. 
[0111] FfG. 16 illustrates a message thinning/ re- 

45 assembling unit according to the seventh embodiment, 
and includes a transmitted data managing unit 212, As 
described in the fifth embodiment, a part of the voice 
message is replaced by left side chat-sound, right side 
chat-sound, front side chat-60und and back side chat- 

50 sound to transmit a plurality of voice messages as one 
background sound message. At this time, the transmit- 
ted data managing unit 212 manages either of the des- 
tination address or the type of the transmitted 
background sound (i.e.. one of the left side chat-sound. 

ss right side chat -sound, front side chat-sound and back 
side chat-sound) as a list. 

[01 1 2] When the combination of the address and the 
background sound which already exists in the list Is 
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transmitted later, a reference message containing only 
the name of the background sound can be transmitted 
instead of the actual data. 

[0113] FIG. 17 illustrates a user terminal device 104 
which is connected to the narrow-band/l ow-6peed net- s 
work, and includes a received data managing unit 221. 
The received data managing unit 221 stores the back- 
ground sound messages, one by one, which are 
received for each type of the background sound by the 
umcast message receiving portion 151. Then, upon to 
receiving the above reference message, the unicast 
message receiving unit 1S1 does not deliver the refer- 
ence message to the virtual space information changing 
unit 144, but delivers it to the received data managing 
unit 221 . The received data managing unit 221 delivers is 
a copy of the message, whose corresponding back- 
ground sound is stored as data, to the virtual space 
information updating unit 144. 
[0114] According to the seventh embodiment, an iden- 
tical background sound of a message is stored in the 20 
unicast message receiving unit 151 is transmitted only 
once. For the second time and thereafter, only the small 
message for referring the name of the data is transmit- 
ted to the user Terminal device. Thus, it is possible to 
reduce the size of the message, and also to reduce the 25 
message communication traffic of the network. 

Embodiment 8. 

[0115] Next, an eighth embodiment of the present 30 
invention is explained below using FIG. 18. The eighth 
embodiment relates to the reduction of messages trans- 
mitted from the user terminal device. FIG. 18 is a flow- 
chart illustrating the operation of the virtual space 
information update examining unit 1 48 according to the 35 
eighth embodiment After starting the operation (step 

5091) , the virtual space information update examining 
unit 148 obtains the threshold of the object movement 
amount on the user terminal device from an application 
program or the user, and registers the threshold (step 40 

5092) . 

[0116] Then, the virtual space information update 
examining unit 148 examines the inside of the virtual 
space information storage managing unit 141 (step 

5093) , and the initial positions of the respective objects 46 
142 in the virtual space (step S094). The virtual space 
information update examining unit 148 warts for a pre- 
determined time (step S095), examines the inside of the 
virtual space information storage managing unit 141 
again (step S096), and observe if there are any objects so 
whose information has been changed (step S097). If 
there are ho changes, the process returns to the step 
S095. 

[0117] If there are some changes, it is examined 
whether the changed information is the position of the ss 
objects (step S098). If it is not the position information of 
the objects, a change notifying message is immediately 
generated (step S099). This message is transmitted to 
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the message transmitting unit (step S099). and the 
process returns to the step S095. 
[01 18] The message which is generated here is a uni- 
cast message for the user terminal devices connected 
to the narrow-band/low-speed network, and a multicast 
message for the devices connected to the wide-band/ 
high-speed network. The message transmitting unit 
here is a unicast message transmitting unit 152 for the 
user terminal devices connected to the narrow- 
band/Iow-speed network, and a multicast message 
transmitting unit 149 for the devices connected to the 
wide-band/ high-speed network. 
[01 19] When the changed information is determined 
to be object position information in the step S098, the 
virtual space information update examining unit 148 
examines whether the amount of the movement of the 
objects from the position in which those objects had 
been held prior to the movement exceeds the threshold 
(step Si 01 ). If the amount of the movement exceeds the 
threshold, the position information of the held objects 
are replaced by the current position information (step 
S102), and the process moves to the above step S099 
and S1Q0, and returns to the step S095. If the amount 
of the movement does not exceed the threshold in the 
step S101. the process returns to the step S095. 
[0120] In the eighth embodiment, as the messages 
are sent from the respective user terminal devices in the 
manner explained above, it is possible not to transmit 
messages relating to slight movement of the objects, 
which other users would hardly notice. Thus, it is possi- 
ble to reduce unnecessary network communication traf- 
fic. 

[0121] The invention being thus described, it will be 
obvious that the same may be varied in many ways. 
Such variations are not to be regarded as a departure 
from the spirit and scope of the invention, and all such 
modifications as would be obvious to one skilled in the 
art are intended to be included within the scope of the 
following claims. 

Claims 

1. A virtual three dimensional space sharing system 
operating in a wide-area network environment hav- 
ing both a wide-band/ high-speed network (101) 
provided with user terminal devices (102) and a 
rwrow-band/1ow~speed network (103) provided 
with user terminal devices (104). for sharing a vir- 
tual three dimensional space comprised of a plural- 
ity of media among said user terminal devices 
comprising: 

(a) a multicast message transmitting unit (111) 
and a multicast message receiving unit (108) 
for performing multicast communication with 
the wideband/high-speed network (101): 

(b) a unicast message transmitting unit (112) 
and a unicast message receiving unit (106) for 
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performing unicast communication with the 
narrow-band/low-speed network (103): 

(c) a multicast group managing unit (107). a 
unicast message generating unit (109) and a 
multicast message generating unit (110). for 
coordinating the multicast communication and 
the unicast communication; and 

(d) a message thinning/ reassembling unit 
(i 13) tor reducing the communication traffic in 
the narrow-band/low-speed network (103). 

The virtual three dimensional space sharing system 
of claim 1, wherein said message thinning/ re- 
assembling unit (113) mixes and compresses a plu- 
rality of sound messages which are transmitted 
from the user terminal devices into one message. 

The virtual three dimensional space sharing device 
of claim 2. wherein said message thinning/ re- 
assembling unit (113) reduces and re-assembles 
messages based on a visual field range and a vis- 
ual field angle parameter of a video object placed in 
the virtual three dimensional space t or based on an 
auditory parameter defined by the distance from a 
sound object. 

The virtual three dimensional space sharing system 
of claim 3, wherein each user terminal device (104) 
connected to the narrow-band/low-speed network 
(103) comprises a communication delay measuring 
unft (181) for measuring adelay time to/from the vir- 
tual three dimensional space sharing system, 
said communication delay measuring unit (181) 
sets and changes an auditory parameter defined by 
the visual field range and the visual field angle 
parameter toward the video object placed in the vir- 
tual three dimensional space or defined by distance 
from the sound object based on a communication 
load measurement. 

The virtual three dimensional space sharing device 
of claim 3, wherein said message thinning/ re- 
assembling unit (113) comprises a background 
sound managing unit (191) for managing the 
recorded background for each direction, 
said background sound managing unit (191) calcu- 
lates the direction of background sounds based on 
the position and the sound volume of a sound 
object and transfers the corresponding background 
sound to the. terminal devices. 

The virtual three dimensional space sharing system 
of claim 3 further comprising a message distribution 
determining unit (211) for controlling a sense bal- 
ance of an auditory sense and a visual sense of the 
sound objects and the vjdeo objects, which com- 
prises an updated virtual space on the user termi- 
nal devices, and 
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said message distribution determining unit (211) 
distributes the message receded from the user Ter- 
minal devices (104) to the sound object and the 
video object based on a sense parameter. 

The virtual three dimensional space sharing system 
of claim 5, wherein said message thinning/ re- 
assembling unit (1 13) comprises a transmitted data 
managing unit (212) for managing background 
sounds which have been already transmitted, said 
message thinning/ reassembling unit (113) trans- 
mits only identifiers, stored in the transmitted data 
managing unit (212), corresponding to background 
sounds to the same user terminal, if the back- 
ground sounds have been already transmitted; and 
said user terminals (104) comprise a received data 
managing unit (221) for storing received back- 
ground sounds, said message thinning/ re-assem- 
bling unit (113) takes out and processes the 
corresponding background data from the received 
data managing unit (22 1). if the identifier corre- 
sponding to the background sounds are received. 

The virtual three dimensional space sharing system 
of claim 1 wherein said user terminal devices (104) 
comprises a virtual space information update 
examining unit (148). 

said virtual space information update examining 
unit (148) transmits a message indicating that a 
state of the video object exceeds a predetermined 
threshold, only when the state of the video object 
comprising the virtual three dimensional space 
exceeds a predetermined threshold. 
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